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COMMUNICATIONS SYSTEM - Tp! 

This invention relates to a communications system which is particularly 
suitable for, but not limited to, video conferencing in which eye contact with a 
transmitted life-size image of a person superimposed into a three dimensional setting 
can be achieved. 

Various forms of communication have been developed for transmitting moving 
images and audio between communicators. Commonly known as video conferencing, 
these systems use a network connection, such as ISDN, to transmit video between two 
locations. Most systems use a video monitor to display the people at the distant 
location and have a camera positioned on top of the monitor to capture an image of 
the users in the home location for transmission to the distant location. 

In a common form of video conferencing the users communicate with the 
people pictured on the monitor. This type of communication is unnatural in that the 
users cannot look directly at each other during their communication. This is because 
the camera is located above the monitor instead of matching to the position of the 
eyes of the person displayed on the monitor. If the user in the home position looks at 
a person on the monitor, the user will be looking away from the camera. As a result 
the image displayed on the monitor in the distant location will show the person 
looking away from the camera. This makes it impossible to have natural eye to eye 
communication. 

Several patents cover the basic principle of using a two way mirror to match a 
line of sight of a person displayed on a monitor or screen with reflected line of view 
by a camera. These inventions achieve eye contact between the user and the 
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transmitted image of the person in the remote location. However, the transmitted 
person appears on a flat screen which does not give a sense of presence in the room. 

With this present invention the user in the home location views the remote 
location displayed on a screen directly in front of him or her. This provides the user 
with a 'telepresence' by presenting a view of the remote location as if they were 
actually there. The people in the remote location will view the user in the home 
location as a life-size image superimposed into a position behind a lectern or seated at 
a table. The superimposed life-size image is positioned so that the camera is matched 
to the field of view for the telepresence of the user in the home location. Since the 
people in the remote location see a life-size image of a person who has a telepresence 
for natural human communication, we call this technique "teleportation". 

This eye to eye contact with the teleported person makes it easier to establish a 
sense of presence which encourages more natural communication. Through this 
format people can be more expressive and draw upon human gestures and expressions 
to communicate emotions and feelings. Instead of having a video conference this 
invention creates a new form of communication that has been coined a "teleportation 
conference". 

This invention provides a system for achieving eye to eye communication by 
matching the position of cameras with the relative position of the eyes of the images 
of the people displayed on screens. 

Embodiments of the present invention reside in, but are not limited to, a 
communications system for linking participants at two separate locations, comprising: 
first and second locations each provided with at least one real time image capturing 
device, at least one image projecting device, an observation zone for occupation by a 



participant at that location and a two-way mirror through which images are viewed, 
the image capturing device(s) at each location being: 

(a) arranged to view any participant occupying the home location 
observation zone directly or indirectly along a line of sight which passes 
through the two-way mirror, and 

(b) linked to the image projecting device at the other location whereby the 
captured image is transmitted from the home location to the remote 
location and projected at the remote location for viewing through the 
corresponding two-way mirror, and 

at least one location being provided with visual depth-cue means visible 
through the two-way mirror from the observation zone so that the remotely 
derived image of a remote participant is seen through the two-way mirror in 
superimposed relation within a three-dimensional setting afforded by said 
visual depth-cue means. 

The visual depth means may be constituted by one or more suitably 
located objects or a further image display (e.g. an image or images projected 
onto a screen or backdrop) located beyond the two-way mirror so as to be 
prominently visible to the observer at that location. 

The term "three dimensional setting" is to be understood in terms of an 
arrangement which gives the observer the impression of the remotely-derived 
image being positioned within a three-dimensional volume beyond the two-way 
mirror. Thus, I do not exclude the possibility that the three dimensional setting 
is implemented by positioning the remotely-derived image (which may be flat 
or stereoscopic) in a plane spaced, along the line of sight of the viewer, from 
one or more further planes at which a further image or images (e.g. scenery) is 
displayed, the further image(s) being flat or stereoscopic. 
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Various other aspects and features of the invention are disclosed in the 
claims appended hereto and in the description that follows. 

The invention may comprise a home location connected by a network to 
one or more remote locations with each location having an arrangement of an 
image-capturing device in the form of a video camera, a two way mirror and an 
image display. The video camera can be any device that captures moving 
images of the user. The camera may output the moving images in a standard 
video format or a format optimised for a network, such as internet protocol for 
transmission over the internet. The two way mirror can be a semi-transparent 
element comprising for example a partially mirrored glass, plastic or film 
material or other form of beam-splitting arrangement. The two way mirror may 
be laminated with one or more sheets of glass or plastic to maintain a flat 
surface. The image display can be a rear projection screen, a front projection 
screen, a retroreflective surface or a large display screen, such as a plasma 
screen, LCD screen or monitor. 

In one embodiment of the invention, at the location of the origination of 
the teleportation conference, the home location, a user seated at a table looks 
forward to see the life-size image of a person from another location called the 
remote location. A two way mirror positioned in front of the user is angled to 
reflect an image of a person displayed on an image display. Processing of the 
image for viewing may involve flipping the image laterally so that the image as 
seen by the the viewer at one location is not a mirror image of the participant at 
the remote location. 

The configurations can be arranged so that the two way mirror is angled 
down to reflect an image display positioned below or angled up to reflect an 
image display positioned above. The image display and the mirror are 
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configured so that the reflected image of the person on the image display 
appears to be on the other side of a table or lectern. In a configuration with a 
table the teleported person may appear to be seated in a chair and the camera 
may be located in a high back with a camera facing towards the user to capture 
the image of the user in the home location. For a configuration with a lectern 
the camera may be located in a draped backdrop behind the lectern. In either 
configuration the position of the eyes of the teleported person is displayed in a 
position to match the line of sight as captured by the camera. 

In a large scale configuration of the invention a substantially full figure 
from head to toe is displayed at substantially life-size. The figure can be 
displayed in a theatre where the teleported person appears to be on the stage. 
The teleported person may be able to see a large screen display of the audience 
so that he/she can interact through natural conversation with members of the 
audience. In this way, dignitaries, performers, musicians, sports stars and 
celebrities could be brought into face to face contact with audiences around the 
world. 

For theatrical productions it is possible to have a second projection 
means to project a backdrop behind the superimposed images of the teleported 
people. In this way it possible to have live performances with teleported people 
appearing to be in front of projected backdrops which could be transmitted 
from the remote locations or be real time computer generated virtual 
environments. 

In the configuration of the invention for a teleportation conference, the 
user in the home location may for example see the three dimensional setting of 
a conference room through the two way mirror and an image of the distant user 
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superimposed into a position behind the table in a plane that is in front of a 
chair. The chair and table serve to provide visual depth cues so that the image 
of the distant user is seen in a three dimensional setting. A camera on the user 
at each location views through the two way mirror to capture an image of the 
user. The video or computer image has the background dropped out to black so 
that the only image being displayed on the screen is the image of the user. This 
black background can be achieved by shooting the user against a black 
background; by using a chromakey technique to replace a colour, such as blue, 
with a black background or by using a retroreflective material with a key light 
positioned close to the camera lens. 

The invention can be configured to have more than two locations 
participating in the teleportation conference with each location having separate 
image displays for each person transmitted from the remote locations. In these 
configurations a separate camera is used for each view of the user. 

In another embodiment of the invention there are two cameras with an 
offset of approximately 65 mm to capture a stereoscopic image which is 
transmitted to the remote location or locations. The two cameras are positioned 
above the two way mirror so that their field of view covers a reflection of the 
user in the two way mirror. The exact location of the two cameras is 
determined by the position of the eyes of the user in the remote location. A 
head tracking system determines the exact position of the eyes of the user in the 
remote location and the co-ordinates are transmitted to the home location. In 
the home location the cameras are moved to the selected position above the 
mirror to match the relative position of the remote user behind the two way 
mirror. 



In this configuration the screen comprises retroreflective material and 
the images are front projected. The two projectors use single lenses and the 
projectors are positioned so that the focal points of the reflected images match 
to the positions of the two eyes of the user. The co-ordinates produced by the 
head tracking device are used to position the projectors in the remote location. 
The projectors are held in a translation stage that moves to a position to be at 
the reflected focal point from the retroreflective surface. In this way the user 
will see an autostereoscopic image. 

In the home location the user will see an autostereoscopic image of the 
users in the remote location. This configuration does pose a problem in that the 
field of view of the cameras will include the projectors seen through the two 
way mirror. In order to minimise the brightness of these projectors it is 
possible to use polarising filters on the projectors and a second set of polarising 
filters set at 90 degrees on the cameras. 

Another method for solving this problem is to have shutters on both the 
cameras and the projectors that are synchronised to alternate between 
projecting the image of the remote location and capturing the image in the 
home location. 

Another method for achieving stereoscopic images is to project two 
images obtained using two separate cameras at the remote location that are 
offset laterally to provide a stereoscopic pair with polarising filters set at 90 
degrees to each other onto a rear projection screen that retains the polarity of 
light as it passes through the screen. While normal rear projection screen 
materials diffuse polarised light, the polarisation of light is retained by using 
clear screen material with a fresnel lens on one side and a lenticular array on 
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the other. The stereoscopic pair of images projected on the high gain rear 
projection screen is reflected by the two way mirror and the resulting 
stereoscopic images may be viewed through 3D polarised glasses. 

The same stereoscopic visual effect can be achieved by using glasses or 
goggles that use LCD shutters to alternate between left and right views of the 
participant from a pair of cameras in the other location. With this system the 
screen could be of a type that would diffuse polarised light. The shutter glasses 
could be used with a CRT monitor, LCD monitor, plasma screen or other type 
of electronic image display system that could alternate the display of the left 
and right images, the arrangement being such that the displayed images are 
reflected by the two way mirror so as to appear to be within the 3 dimensional 
setting located beyond the two way mirror. 

A method for achieving stereoscopic effect without the use of polarising 
glasses or LCD goggles is to use a lenticular screen on a monitor which 
displays a set of offset views for reflection by the two way mirror so as to 
appear to be within the three dimensional setting. This method is ideal for 
autostereoscopic viewing from several positions simultaneously. The size of 
displays with this technique is governed by the size of high resolution monitors 
available. 

With this stereoscopic display the person may be projected onto the 
screen with a black background. Their stereoscopic image will be reflected to 
appear within the three dimensional space in front of the viewer. In this 
manner the person and any objects captured by the cameras will appear to have 
true depth as they are seen in the three dimensional space. Unlike the single 
image that will appear to be within the single plane of the reflected image, the 




person in the stereoscopic image could appear to move closer and further away 
within the three dimensional space behind the two way mirror and could even 
appear to reach forward of the two way mirror. 

A particularly advantageous feature of the invention is that a life-size 
image of a person in a remote location may be made to appear in a three 
dimensional setting that may include objects within the image area. It is then 
possible to assign functions to be performed when the image of the remote 
person intersects with the physical location of one of the objects, i.e. actions on 
the part of the user in the remote location may be correlated with physical 
objects in the three dimensional setting at the home location so as to give the 
impression of interaction of the remotely-captured image with the physical 
objects at the home location. As an example, a remote person could trigger a 
function by reaching to the location of a button within the image area. Since 
there is no physical presence of the remote person, the function could be 
triggered by a software application that would recognise the movement of a 
hand as it entered a zone dedicated to a predetermined function. In this way a 
remote person could perform functions in a manner similar to actually being in 
the remote location. 

Another method for registering a function is for the person in the home 
location to make physical contact with an object in the home location. The 
physical contact will be registered as a set of measurable pressures and/or 
physical movements. These registered physical pressures and/or movements 
will be activated in the remote location on a similar object to mimic the action 
taken in the home location. This will result in a co-ordinated display of an 
image of the person in the remote location activating actual physical movement 
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or physical change to objects in the three dimensional space. This effect can be 
very useful in training or demonstrations 

The interaction of a flat life-size image of a person with objects in the 
three dimensional space can work effectively if the objects are within the plane 
of the flat image. However, this interaction within the three dimensional space 
can be most effective with a stereoscopic image of a life-size person from a 
remote location. 

The invention will now be described by way of example with reference 
to the accompanying drawings in which: 

Figure 1 shows one system in accordance with the invention with a user 
seated at a table with a two way mirror that reflects an image of a user in a 
remote location and provides a view through the mirror to a setting with a 
chair so that the image of the remote user is superimposed into the scene 
and a camera captures an image of the user through the two way mirror. 

Figure 2 shows the system in the configuration in the remote location with 
a mirror image of all of the same features of the home location. 

Figure 3 shows the system with a shorter person at the home location. 

Figure 4 shows the system in the configuration of the remote location with 
the camera on the user in a lower position in order to match the height of 
the eyes of the user in the home location. 
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Figure 5 shows the system in a configuration with the image display below 
the two way mirror and the superimposed image of the remote person 
positioned in a chair. 

Figure 6 shows the system with the image display housed in a lectern with 
the superimposed remote person in front of a curtain backdrop. 

Figure 7 shows an embodiment of the system used for autostereoscopic 
viewing of a person in a remote location with a pair of projectors 
projecting an image on a retroreflective surface and a pair of cameras 
capturing the reflected image of the user. 

Figure 8 shows the embodiment of the system in the autostereoscopic 
configuration for the remote location. 

Figure 9 shows the system with the user in the home location with a closer 
viewing position with an adjusted position of the projectors to match the 
relative distance from the retroreflective screen. . 

Figure 10 shows the system in the remote location with the camera on the 
user moved in closer to match the relative distance of the user in the home 
position to the user in the remote location. 

Figure 1 1 shows an embodiment of the system where the person in the 
home location is a head to toe figure displayed on a screen positioned 
above the two way mirror so that it is superimposed onto a stage and is 
viewed by an audience. 
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Figure 12 shows another configuration of the system in a theatre setting 
where the two way mirror is angled down to reflect a screen below which 
has an image of a full head to toe figure. 

Figure 13 shows a configuration of the system where a full height view of 
the user is captured by camera in the home location and the user has a 
view of an audience in a remote location displayed on a large screen. 

Figure 14 shows the system in a configuration of an exhibition stand 
where group of standing people can view a superimposed image of a user 
from the home location. 

Figure 15 shows a top view of the system in the configuration for an 
exhibition stand where the camera angle of view captures an image of a 
group of people. 

Figure 16 shows the top view of the system at the home location where the 
user can see an image positioned at an angle of view that matches the 
angle of view of the camera in the remote location on the group of people 
looking into the exhibition stand. 

Figure 17 shows a top view of the system in a configuration at an 
exhibition stand with two cameras to cover a wider area showing a group 
of people. 

Figure 1 8 shows a top view of the system in a configuration at the home 
location with two screens that match the cameras angles of view of the 
group at the remote location. 
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Figure 19 shows a top view of triangular table that represents the layout 
for a teleportation conference for three people. 

Figure 20 shows the top view of the system in a configuration for the 
home location for a three way teleportation conference. 

Figure 21 shows the top view of the system in a configuration of the first 
remote location for a three way teleportation conference. 



Figure 22 shows the top view of the system in a configuration of the 
second remote location for a three way teleportation conference. 

Figure 23 shows a configuration with a rear projection screen for 
displaying an image of a remote person and a control object in the plane of 
the reflected image. 

Figure 24 shows a configuration with a rear projection screen displaying a 
stereoscopic image with a number of control objects at different depths. 

Referring to drawing Figure 1 a user 1 is in the home location for a 
teleportation conference. The user 1 looks forward to see an image on a screen 
3 that is reflected off a beam splitter in the form of a two way mirror 2. The 
two way mirror 2 and the screen 3 are aligned so that the reflected image is 
superimposed in a three dimensional setting behind table 8 at position 4 which 
appears to be in front of the chair 7 and background wall 101, the chair and 
table serving as visible depth cues for the observer. The rear projection screen 
3 has an image projected from projector 10 that is reflected off mirror 9. A 
camera 5 captures an image of the user 1 through the two way mirror 2. In this 
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and certain but not all other embodiments to be described below, the camera 
views the participant directly along a line of sight which passes through the 
two-way mirror and through the image 4. The user 1 is viewed against a 
background wall 102 which is either black, a colour for chromakey or a 
retroreflective material. The user 1 can input computer commands through a 
keyboard in a console 6 which also incorporates a standard monitor or touch 
screen monitor. 

In Figure 2 a user in a remote location 21 looks through a two way 
mirror 22 to see a reflected image of screen 23 that appears to be positioned in 
a three dimensional setting behind table 28 at position 24 and in front of chair 
27 and background wall 104. The image at position 24 is the user 1 in Figure 1 
as seen by camera 5. The user 21 can input information and control computer 
functions at console 26 that will be linked by a network to the console 6 at the 
home location represented in Figure 1. A camera 25 captures an image through 
the two way mirror 22 of the user 21 so that it can be transmitted to the home 
location for display on screen 3 in Figure 1 . Again the table and chair serve as 
visual depth cues. 

Figure 3 represents the home location with a different user 12 that is 
shorter than the original user 1 in Figure 1 . 

Figure 4 shows the remote location with the same user 21 as illustrated 
in Figure 2. The camera 25 is lower than in Figure 2 so that the height of the 
camera 25 matches the position of the eyes of the shorter user 12 in Figure 3. 
The output of the camera 25 is transmitted over a network to the home location 
and displayed on screen 3 in Figure 3 so that the user 12 will see the reflected 




image in the position 4 at an angle of view that matches the angle of view of the 
user 12. 

Figure 5 shows a user 1 1 seated in a chair 20 that can have the height 
adjusted 120 to position of the eyes of the user at the correct placement for the 
camera 17. For the purposes of establishing the correct height of the person's 
eyes, the output of camera 17 is displayed on monitor 15 which is viewed as a 
superimposed image at 16. An alignment reference is displayed on the monitor 
15 so the user can easily set the correct height. The camera sees the user 1 1, 
the chair 20 and the background 106, The chair 20 and the background 106 are 
black, a chromakey material or a retroreflective material so that the final image 
can be transmitted as solely the image of the user 1 1 against a black 
background. The camera 17 also sees a reflection of the ceiling 107, however 
the ceiling is black so that it does not register as an image with the camera 17. 
The user 1 1 looks forward to see a chair 19 and background wall 105 with a 
superimposed image 16 of a remote person displayed on a video display 15 
which is reflected by a two way mirror 14. The user can share information with 
the remote person through a networked computer 18. 

Figure 6 shows a user 13 standing in front of a lectern with a video 
display 15 which reflects on a two way mirror 14 for showing a superimposed 
image 16 in a three dimensional setting with the lectern serving as visual depth 
cue means. A camera 17 is concealed in a draped background 68. 

Figure 7 shows a user 3 1 in a home location for the system in a 
configuration for an autostereoscopic teleportation conference. The user 3 1 
looks forward through a two way mirror 32 to see a retroreflective screen 34. 
The user 3 1 also sees the ceiling 39 reflected off the two way mirror 32. Since 
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the ceiling 39 is black it does not add any superimposed image onto the image 
displayed on the retroreflective material 34. A projection rig 35 holds a pair of 
projectors that have projection paths that have a convergence that is 
approximately 65 mm horizontally offset to approximate a typical interocular 
offset for a user. The rig with two projectors is positioned so that the projection 
reflects off the two way mirror 32 to the retroreflective screen. The light 
reflecting off the retroreflective screen passes through the two way mirror and 
is focussed onto the left and right eyes respectively of the user 31. A camera 
rig 33 holds two cameras so that the field of view for the two cameras are offset 
approximately 65 mm in order that they can capture stereoscopic pairs of 
images. The cameras are directed toward the two way mirror at an angle to 
capture a stereoscopic image of the user 31. 

The user 3 1 wears a head tracking device 36 that is used to provide co- 
ordinates of the position of the eyes of the user 3 1 . The projection rig 35 is 
held in position by a translation stage 37 that moves projection rig 35 into a 
position matching the relative position of the eyes of the user 3 1 . Another 
method which may be used instead for tracking the position of the eyes of the 
users is through a stationary camera 38 which views the area of movement of 
the person and uses a computer to analyse the image to determine the exact 
location of their eyes for the positioning of the pair of projectors at both 
locations. 

Figure 8 shows a user 41 in a remote location for an autostereoscopic 
teleportation conference. The user 41 looks through the two way mirror to see 
the retroreflective screen 44. The projection rig 45 has two projectors that 
project the images captured by the camera rig 33 in Figure 7. The camera rig 
43 is positioned so that the field of view captures the image of the user 41 as 
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seen as a reflection off the two way mirror 42. The images from the two 
cameras in the camera rig 43 are transmitted to the home location illustrated in 
Figure 7 and projected by the pair of projectors in the rig 35 so that the user 3 1 
can see the stereoscopic image on the retroreflective screen 34. It will be noted 
that the camera 33, 43 in the embodiment of Figures 7 and 8 sees the 
participant along a line of sight which indirectly passes through the two way 
mirror so that the eyes of the participant are effectively seen through the image 
34. 

Figure 9 shows the user 31 in the home location as he/she leans forward 
to get a closer view of the images from the remote location as displayed on the 
retroreflective screen 34. The head tracking device 36 determines the co- 
ordinates of the location of the eyes of the user 3 1 . In response, the translation 
stage 37 moves the projection rig 35 closer to match the relative distance and 
angle of view of the user 31. 

Figure 10 shows the remote location with the translation stage 48 having 
moved the camera rig 43 in a closer position to match the relative position of 
the eyes of the user 3 1 in the home location shown in Figure 9 as detected by 
the head tracking device at the home location. 

Figure 1 1 shows a configuration of the system for teleportation 
conferencing is with an audience at a remote location in the form of a theatre. 
From the observation zone in front of the stage 64, the audience 69 looks 
through the two way mirror 65 to see the stage 64 and the backdrop 68. A 
projector 66 projects an image on mirror 67 which reflects to be displayed on 
screen 63. The audience sees a reflection of screen 63 which appears 
superimposed into the stage setting at position 62 within the three dimensional 
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stage setting. The camera 61 captures an image of the audience through the 
two way mirror 65. The stage floor 64 is black so that the reflection off the 
mirror 65 does not superimpose any light onto the image captured by camera 
61. A second projector 130 projects onto the backdrop 68 to display an image 
providing a background setting for the superimposed image of the person 62 
and also providing a visual depth cue. 

Figure 12 shows another configuration of the system with a two way 
mirror 65 angled down to reflect the image on the screen 63 so that it appears 
superimposed into the setting onto the stage 64 and in front of the backdrop 68 
at position 62. In this configuration the second projector 13 1 is positioned 
above mirror 65 for projecting a background image on the backdrop 68. 

Figure 13 shows the home location for the teleportation conference with 
user 5 1 standing on a stage 55. A camera 53 looks through a small hole in 
screen 54 and has a field of view that captures an image of the full height of the 
user. The user looks forward at the same angle of view as the camera 61 in 
Figure 1 1 so that the user sees the audience displayed on the screen 54 in the 
same orientation as the view of audience in the remote location. 

Figure 14 shows the system as an exhibition stand with a group of 
people 69 looking into the stand to see a user from the home location 
superimposed into the stand at position 62 behind lectern 64 and in front of a 
background 68. Camera 61 captures a view of the group of people 69 as seen 
through the two way mirror 65. 



Figure 15 shows a top view of the exhibition stand with the group of 
people 69 within the field of view 70 as seen by the camera 61. 
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Figure 16 shows a top view of the home location with the user 5 1 
looking at the monitor or screen 54 showing the field of view 71 at the same 
angle of view 70 as the camera 61 in Figure 15 in the remote location. 

Figure 17 shows a top view of the remote location at an exhibition stand 
with camera 61 capturing an image of a group of people 69 with a coverage of 
a set angle of view 70. A second camera 71 covers an angle of view 72 that 
captures images of more people 79. 

Figure 18 shows a user 5 1 at the home location with a field of view 71 
being displayed on a monitor or screen 54 that matches the angle of view 70 of 
camera 61 in the remote location in Figure 17. A second field of view 73 that 
matches the angle of view 72 of the camera 71 the remote location in Figure 17 
is displayed on the monitor or screen 75. 

Figure 19 shows a top view of the configuration of a teleportation 
conference with three people where user 1 sees an image of a user 8 1 in one 
remote location and user 82 from another remote location. In this configuration 
the users 8 1 and 82 will also be able to see and communicate with each other. 

Figure 20 shows the user 1 in the home location with a camera 83 to 
capture his/her image at the correct angle for viewing by user 8 1 and a camera 
84 to capture his/her image for the correct viewing angle for user 82. A two 
way mirror 91 is used to superimpose images of users 81 and 82 in positions 94 
and 95 respectively. 
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Figure 21 shows the user 81 with camera 85 capturing his/her image 
from the correct angle for viewing by the remote user 82 and the camera 86 
capturing his/her from the correct angle of view for the user 1 in the home 
location. A two way mirror 92 is used to superimpose images of users 1 and 82 
into positions 96 and 97 respectively. 

Figure 22 shows the user 82 with camera 87 capturing his/her image at 
the correct angle for viewing for the user 81 and camera 88 capturing his/her 
image from the correct angle for the user 1 in the home position. A two way 
mirror 93 is used to superimpose images of users 81 and 1 into positions 98 and 
99 respectively. 

Figure 23 shows a user 20 1 viewing screen 204 which is a reflected on 
to a two way mirror 203 so that the image of the remote user appears to be 
present in the plane depicted by reference numeral 209 and hence within the 
three dimensional setting beyond the mirror 203. Camera 206 views the user 
201 through the image 209. Projector 205 projects the image of the remote 
user, the image being reflected on mirror 21 1 to be displayed on a rear 
projection screen 204. A physical object 212 is placed in the plane of the 
apparent image 209. A physical component, such as a table top, is positioned to 
provide a visual barrier to match the bottom of the superimposed image. 

Figure 24 shows a user 301 wearing a pair of polarising glasses or LCD 
shutter glasses 302. A pair of projectors 305 project images that reflect on 
mirror 3 1 1 to be displayed on a rear projection screen 304. The pair of images 
projected on screen 304 may be polarised in planes at 90 degrees to each other 
or the two images may be projected alternately in rapid succession. The two 
way mirror 303 reflects the images on screen 304 so that they appear to be in 




the plane of 309 where, through persistence of vision, the images are 
superimposed as seen as a stereoscopic image. A number of objects 3 12, 3 13 
and 314 are in the three dimensional space around the image plane of 309. 
Since the viewer is wearing polarising glasses or LCD shutter glasses as 
described hereinbefore, the user will see a stereoscopic image that will appear 
to be at a location that could be at the plane of the reflected image 309 or in a 
position in front or behind the plane 309. 



From the foregoing, a number of features will be apparent including the 
following: 



The invention may be embodied in an arrangement for displaying a 

substantially life-size live image of a person from a remote location in a 

home location while providing the person in the remote location with a 

telepresence of the home location by means of a video presentation system 

for displaying a life-size live image of a part or whole person; 

a two way mirror through which a user views both the three dimensional 

setting and the superimposed video image of the person; 

a video camera positioned in line with the eyes of the superimposed image 

of the person to secure eye-to-eye contact; 

a network connection between the home location and the remote location 
for transmitting video images in both directions; 

and the associated components of audio equipment, lighting, backgrounds 
and rigs to achieve the eye to eye contact between people in two different 
locations. 



The background for the video image of the remote person may be black 
and the three dimensional setting viewed through the two way mirror may 
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be illuminated so that the superimposed image of the person appears to be 
a life-size live person within the three dimensional setting without any 
visible indication of the borders of the video display screen or monitor. 

The height of the camera or the height of the person to be viewed by the 
camera may be adjustable so that the eye level of the person matches the 
height of the camera in the corresponding location to achieve accurate 
telepresence of the remote location. 

The image of one or more people may be displayed as a life-size head and 
shoulders live image or images superimposed into a position behind a 
console and directly in front of a chair to give the impression of the person 
actually sitting in the chair or behind a lectern and in front of a background 
drape, or behind a table, work surface or counter and in front of a 
background wall. 

In some instances, substantially full head to toe image(s) of one or more 
people may be displayed as life-size live images superimposed onto a 
stage and in front of a background drape. 

Where necessary, shutters or polarising filters may be used on the cameras 
and the projectors to avoid or minimise light projecting into the cameras 
by alternating the shutters. 

The network connection may use standard video conference protocols for 
ISDN connections or internet protocol and the internet for the connections. 




CLAIMS 

1. A communications system for linking participants at two separate 
locations, comprising: 

first and second locations each provided with at least one real time image 
capturing device, at least one image projecting device, an observation zone for 
occupation by a participant at that location and a two-way mirror through 
which images are viewed, the image capturing device(s) at each location being: 

(a) arranged to view any participant occupying the home location 
observation zone directly or indirectly along a line of sight which passes 
through the two-way mirror, and 

(b) linked to the image projecting device at the other location whereby the 
captured image is transmitted from the home location to the remote 
location and projected at the remote location for viewing through the 
corresponding two-way mirror, and 

at least one location being provided with visual depth-cue means visible 
through the two-way mirror from the observation zone so that the remotely 
derived image of a remote participant is seen through the two-way mirror in 
superimposed relation within a three-dimensional setting afforded by said 
visual depth-cue means. 

2. A system as claimed in Claim 1 in which the setting includes one or 
more physical objects located on the opposite side of the two-way mirror to the 
observation zone. 
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3. A system as claimed in Claim 2 in which the object or objects are 
located at positions forwardly and/or rearwardly of the position of the remotely- 
derived image. 

4. A system as claimed in Claim 2 in which the setting comprises a chair, 
the back of which is located rearwardly of the position of the remotely-derived 
image. 

5. A system as claimed in Claim 2 in which the setting comprises a desk, 
table, counter, console or the like located forwardly of the position of the 
remotely-derived image. 

6. A system as claimed in Claim 2 in which the setting comprises a lectern 
located forwardly of the position of the remotely-derived image. 

7. A system as claimed in Claim 2 in which the setting comprises a stage. 

8. A system as claimed in Claim 7 in which a substantially full height 
image of the remote participant is projected for viewing against the stage 
setting. 

9. A system as claimed in Claim 8 in which the image is positioned at a 
location intermediate the forward and rearward extremities of the stage setting. 

10. A system as claimed in Claim 7 or 8 in which the stage setting includes a 
background located rearwardly of the position of the remotely-captured image. 



11. A system as claimed in any one of Claims 1 to 10 in which the setting 
comprises a background located rearwardly of the position of the remotely- 
derived image, means being provided for producing an image on the 
background for viewing through the two-way mirror. 

12. A system as claimed in any one of Claims 1 to 1 1 in which the remotely- 
derived image is projected so that, from the observation zone, it represents the 
remote participant as a substantially life-size, optionally substantially full 
height, image in relation to the setting. 

13. A system as claimed in any one of Claims 1 to 12 including means for 
illuminating one or more physical objects constituting said depth-cue means. 

14. A system as claimed in any one of Claims 1 to 13 in which the remotely- 
captured image of a participant comprises a background which is substantially 
non-visible when viewed through the two-way mirror by a participant at the 
home location. 

15. A system as claimed in any one of Claims 1 to 14 in which the two-way 
mirror is inclined relative to the line of sight of a participant stationed in the 
observation zone. 

16. A system as claimed in Claim 15 in which the two-way mirror is 
inclined about a horizontal axis. 

17. A system as claimed in Claim 16 in which the remotely-captured image 
is incident on the two-way mirror from a location below the two-way mirror. 



-26- 



18. A system as claimed in Claim 1 6 in which the remotely-captured image 
is incident on the two-way mirror from a location above the two-way mirror. 

19. A system as claimed in any one of Claims 1 to 18 including means for 
adjusting the image-capturing device(s) and/or the participants so that the eye- 
level of the participant is substantially aligned with the line of sight of the 
image-capturing device viewing the participant. 

20. A system as claimed in any one of Claims 1 to 19 in which the 
arrangement is such that the remotely-captured images are displayed so as to 
create a stereoscopic visual effect when viewed from the home location 
observation zone. 

21. A system as claimed in Claim 20 in which the remotely-captured images 
are processed using light polarising elements to form pairs of images having 
different polarisations so that a stereoscopic image of the remote participant 
seen when viewed at the home location using through polarised glasses. 



is 



22. A system as claimed in Claim 20 in which the stereoscopic visual effect 
is produced by alternating between images of the remote participant(s) captured 
from different viewpoints. 

23. A system as claimed in any one of Claims 1 to 19 in which at least one 
of said locations is provided with at least two image-capturing devices for 
viewing the participant(s) at that location from different angles and in which at 
least one of said locations is provided with at least two image-projecting 
devices linked to the remote image-capturing devices. 
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24. A system as claimed in Claim 23 in which the arrangement is such that 
the remotely-captured images are displayed so as to create a stereoscopic effect 
when viewed from the home observation zone. 

25. A system as claimed in Claim 23 or 24 in which the remotely-captured 
images are projected onto a retroreflective screen located at the opposite side of 
the two-way mirror to the observation zone whereby the remotely-captured 
images are viewed in retroreflection at the observation zone. 

26. A system as claimed in any one of Claims 1 to 25 including means for 
tracking the eye position of a participant in the observation zone and means for 
adjusting the image-projecting devices in dependence upon such tracked 
positioning. 

27. A system as claimed in Claim 26 in which the tracking means includes 
an item of headwear to be worn by a participant in use of the system. 

28. A system as claimed in Claim 26 in which the tracking means includes 
camera means for observing the participant and means for analysing the images 
captured thereby to determine eye positioning. 

29. A system as claimed in any one of Claims 1 to 28 including means for 
correlating actions of a participant at the remote location with one or more 
physical objects in the home location three dimensional setting so as to 
produce the impression of interaction of the image observed at the home 
location with such physical object(s). 
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30. A communications system for linking participants at two separate 
locations, comprising: 

a first location provided with at least one real time image capturing device and 
a zone for occupation by one or more participants, the image-capturing device 
being arranged to view that zone; 

a second location provided with at least one image projecting device linked to 
the image-capturing device at said first location, an observation zone for 
occupation by one or more participants at the second location, a three 
dimensional setting with visual depth cue means viewable from that 
observation zone and two-way mirror means interposed between that 
observation zone and the three dimensional setting, 

the arrangement being such that the captured image is transmitted from said 
first location to the second location and is projected at the second location for 
viewing of the remote participant(s) through the corresponding two-way mirror 
means in superimposed relation with the three dimensional setting. 

31. A system as claimed in Claim 30 in which a substantially full height 
image of the remote participant is projected for viewing within the three 
dimensional setting. 

32. A system as claimed in Claim 3 1 in which the setting comprises a stage 
and means for displaying a further image constituting a visual depth cue means. 

33. A system as claimed in any one of Claims 30 to 32 incorporating the 
features of any one of Claims 2 to 29. 



34. 



A viewing arrangement for use in a communications system 



as 



claimed in any one of Claims 1 to 33, comprising at least one image projecting 
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device capable of being linked to an image-capturing device at a remote 
location, an observation zone for occupation by one or more participants, a 
three dimensional setting with visual depth cue means viewable from that 
observation zone and two-way mirror means interposed between that 
observation zone and the three dimensional setting, the arrangement being such 
that a captured image transmitted from said remote location to the image 
projecting device is projected for viewing of a remote participant(s) through the 
corresponding two-way mirror means in superimposed relation with the three 
dimensional setting. 

35. Any novel feature or combination of features as disclosed hereinbefore. 
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ABSTRACT 

COMMUNICATIONS SYSTEM 

An arrangement is provided for displaying a life-size live image of a person from a 
remote location in a three dimensional setting in a home location while providing the 
person in the remote location with a telepresence of the home location through the 
invention comprising: a video presentation system for displaying a person on a black 
background; a two way mirror for viewing both the setting and the superimposed 
video image of the person; a video camera or pair of cameras positioned in line with 
the eyes of the superimposed image of the person; and a network connection between 
the home location and the remote location. Stereoscopic views may be used in 
conjunction with the two way mirror and a retroreflective surface to display life-size 
autostereoscopic live images of a person from a remote location. 
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